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© Moving picture signal progressive coding system. 

© A progressive coding system wherein a mov- 
ing picture signal is separated into a low fre- 
quency component of a little luminance 
variation and a high frequency component of 
much luminance variation, and the components 
are respectively coded by motion compensated 
predictive coding. The high frequency compo- r 
nent is motion-compensated according to a 
motion quantity of the low frequency compo- 
nent. The motion quantity is modified by a 
sampling ratio of the moving picture signal and 
low frequency component The motion quantity 
can be detected based on the low frequency 
component in a present frame and those sub- 
jected to intraframe coding in previous and ( 
subsequent intraframes to the present frame. A 
predictive low frequency component is then 
obtained by motion compensation using the 
motion quantity according to time intervals of 
the low frequency components between the 
frames. A predictive high frequency component 
is also obtained like the predictive low fre- 
quency component referring to the time inter- 
val. A motion quantity of the moving picture 
signal is obtained for motion-compensating the 
low and high frequency components. 
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BACKGROUND OF THE INVENTION 

The present invention relates to a picture signal 
coding system for compressing a moving picture sig- 
nal by progressive coding. 

The progressive coding is a method for compres- 
sing a picture signal by respectively coding a low fre- 
quency component of a little luminance variation and 
a high frequency component of much luminance vari- 
ation, both separated from the picture signal. A picture 
of low resolution is reproduced by decoding the low 
frequency component thus coded and a picture of 
high resolution is reproduced by decoding both the 
low and high frequency components thus coded. 

The following is well known in the progressing 
coding of a moving picture signal. A moving picture 
signal of an original moving picture is first sub-sam- 
pled to produce a low frequency component of a little 
luminance variation in a present frame. A motion 
quantity (motion vector) on a decoded low frequency 
component in a previous frame and the low frequency 
component is detected. 

Motion compensation is conducted using the 
motion vector to produce a predictive low frequency 
component The predictive low frequency component 
is subtracted from the low frequency component to 
obtain a predictive error. The predictive error is then 
subjected to the orthogonal transform and quanti- 
zation. Quantized transform coefficients and motion 
vector are then subjected to variable length coding 
such as the Huffman coding to code the low frequency 
component 

The quantized transform coefficients and motion 
vector are further subjected to the inverse orthogonal 
transform and de-quantization to decode the low fre- 
quency component thus coded. The low frequency 
component thus decoded is over-sampled to produce 
an over-sampled decoded low frequency component. 

The over-sampled decoded low frequency com- 
ponent is subtracted from the moving picture signal of 
the original moving picture to produce a high fre- 
quency component of much luminance variation. A 
motion vector on a decoded high frequency compo- 
nent in a previous frame and the high frequency com- 
ponent in a present frame is detected. 

Motion compensation is conducted using the 
motion vector to produce a predictive high frequency 
component The predictive high frequency compo- 
nent is subtracted from the high frequency component 
to obtain a predictive error. The predictive error is then 
subjected to the orthogonal transform and quanti- 
zation. Quantized transform coefficients and motion 
vector are subjected to variable length coding such as 
the Huffman coding to code the high frequency com- 
ponent 

A moving picture of low resolution is obtained by 
decoding the coded low frequency component and 
the original moving picture is obtained by adding the 



decoded high frequency component and over-sam- 
pled decoded low frequency component. 

The above mentioned method has the following 
disadvantages. A quantization error is produced when 
5 the low frequency component is coded and is then 
coded with the high frequency component. This leads 
to motion vector detection of low precision on the high 
frequency component. 

Furthermore, motion vectors are respectively 

10 detected on the low and high frequency components. 
This results in the predictive low and high frequency 
components with no correlation therebetween. 
Accordingly, when monitored as moving pictures, the 
low and high frequency components seem to show 

is different actions. 

Moreover, both the motion vectors on the low and 
high frequency components also should be proces- 
sed in a coding system. This results in an increase in 
the amount of data to be coded. 

20 There are still further disadvantages. Backward 

reproduction is sometimes required when magnetic 
tapes and optical discs are used for example. In this 
case, the above mentioned progressive coding with 
the prediction using data in a previous frame cannot 

25 conduct decoding because a predictive signal for the 
decoding cannot be obtained. 

Moreover, in communication networks, it some- 
times happens that coded data only for a tow fre- 
quency component is transmitted through limited 

30 transmission lines without the following coded data for 
a high frequency component. 

SUMMARY OF THE INVENTION 

35 An object of the invention is to provide a progress- 

ive coding system for coding a moving picture signal 
wherein the amount of data to be coded on a high fre- 
quency component is highly decreased. 

According to the present invention there is pro- 

40 vided a progressive coding system wherein a moving 
picture signal is separated into a low frequency com- 
ponent of a little luminance variation and a high fre- 
quency component of much luminance variation, and 
the components are respectively coded by motion 

45 compensated predictive coding, comprises motion 
quantity modification means for modifying a motion 
quantity of the low frequency component according to 
a sampling ratio of the moving picture signal and low 
frequency component and motion compensation 

so means for motion-compensating the high frequency 
component according to the motion quantity thus 
modified. 

There is also provided a progressive coding sys- 
tem wherein a moving picture signal in a present 
55 frame is separated into a low frequency component of 
a little luminance variation in the present frame and a 
high frequency component of much luminance vari- 
ation in the present frame, and the components are re- 
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spectively coded by motion compensated predictive 
coding, comprises motion detection means for re- 
spectively detecting motion quantities on the low fre- 
quency component in the present frame and low 
frequency components in previous and subsequent 
intraframes to the present frame, first motion com- 
pensation means for respectively motion-compensat- 
ing the low frequency components in the previous and 
subsequent intraframes according to the respective 
motion quantities to produce first and second pre- 
predictive low frequency components, weighting the 
pre-predictive low frequency components according 
to time intervals between the frames thereof to add 
the pre-predictive low frequency components thus 
weighted to each other, thus producing a third pre- 
predictive low frequency component, selecting one of 
the first, second and third pre-predictive low fre- 
quency components, of the least predictive error, as 
a predictive low frequency component for the motion 
compensated predictive coding and out putting a 
selection signal indicating which is selected among 
the first, second and third pre-predictive low fre- 
quency components, motion quantity modification 
means for respectively modifying the motion quan- 
tities according to a sampling ratio of the moving pic- 
ture signal and low frequency component, and second 
motion compensation means responsive to the selec- 
tion signal for producing a predictive high frequency 
component on the basis of the modified motion quan- 
tities and the high frequency component of either the 
previous or subsequent intraframe or both the intraf- 
rames in a manner identical to that in which the selec- 
ted one of the first, second and third pre-predictive low 
frequency components is produced. 

There is further provided a progressive coding 
system wherein a moving picture signal is separated 
into a low frequency component of a little luminance 
variation and a high frequency component of much 
luminance variation, and the components are respect- 
ively coded by motion compensated predictive cod- 
ing, comprises motion quantity modification means for 
modifying a motion quantity of the moving picture sig- 
nal according to a sampling ratio of the moving picture 
signal and low frequency component first motion 
compensation means for motion-compensating the 
low frequency component according to the motion 
quantity thus modified and second motion compens- 
ation means for motion-compensating the high fre- 
quency component according to the motion quantity 
thus modified. 

The other objects and features of this invention 
will become understood from the following description 
with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a block diagram showing a preferred 
embodiment of a moving picture signal progress- 
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ive coding system according to the present inven- 
tion; 

FIG. 2 is a block diagram showing another prefer- 
red embodiment of the system according to the 
5 present invention; 

FIG. 3 is a block diagram showing a further pre- 
ferred embodiment of the system according to the 
present invention; 

FIG. 4A is a view for explaining recursive-type 
10 interframe coding by the system shown in FIG. 1 ; 

FIG. 4B is a view for explaining adaptive previous 

and subsequent predictive interframe coding by 

the system shown in FIG. 2; and 

FIG. 5 is a view for explaining calculation of a mo- 
ts tion-compen sated previous and subsequent 

interpolation predicted value. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

20 

A preferred embodiment of the coding system 
according to the present invention is shown in FIG. 1 . 
The incoming original moving picture signal is subjec- 
ted to a sub sampling circuit 1 which produces a low 

25 frequency component of a little luminance variation in 
a present frame. The low frequency component is 
applied to a motion vector detection circuit 2 which 
detects a motion vector on a decoded low frequency 
component in a previous frame stored in a frame . 

30 memory 3 and the low frequency component in the * 
present frame. The motion vector can be detected by . 
such as block matching. 

The motion vector is supplied to a 'first motion 
compensation circuit 4. Also supplied to the circuit 4 

35 is the decoded low frequency component from the 
frame memory 3. Motion compensation is conducted 
using the motion vector in the circuit 4 to produce a 
predictive low frequency component 

The predictive low frequency component is sub- 

40 tracted, in a sub tract or 1a, from the low frequency 
component sent from the sub sampling circuit 1 to pro- 
duce a predictive error. The predictive error is divided 
into blocks of a plurality of pixels in an orthogonal 
transformer 5 which produces transform coefficients 

45 by orthogonal transform such as DCT (Discrete 
Cosine Transform). The transform coefficients and 
motion vector are then quantized by a quantizer 6. 

The transform coefficients and motion vector thus 
quantized are subjected to a variable length coding 

so circuit 7 which effectively codes the low frequency 
component with reduction of the amount of data by 
such as the Huffman coding. 

The transform coefficients and motion vector thus 
quantized from the quantizer 6 are de-quantized by a 

55 de-quantizer 8 and subjected to inverse orthogonal 
transform such as I DCT (Inverse Discrete Cosine 
Transform) by an inverse orthogonal transformer 9 to 
produce a decoded predictive error. The decoded pre- 

3 
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dictive error is added by an adder 9a to the predictive 
low frequency component sent from the first motion 
compensation circuit 4 to produce the decoded low 
frequency component which is then stored in the 
frame memory 3. 5 

The decoded low frequency component is over- 
sampled by an over sampling circuit 1 0 to produce an 
over-sampled decoded low frequency component. 
The over-sampled decoded low frequency compo- 
nent is subtracted from the incoming original moving 10 
picture signal by a subtracter 10a to produce a high 
frequency component of much luminance variation. 

The motion vector on the low frequency compo- 
nent detected by the first motion vector detection cir- 
cuit 2 is modified according to a sampling ratio of the 15 
original moving picture and the low frequency compo- 
nent by a motion quantity modification circuit 11a. The 
motion vector thus modified is supplied to a second 
motion compensation circuit 11b. Also supplied to the 
circuit 11b is a decoded high frequency component 20 
stored in a frame memory 12. Motion compensation is 
conducted using the motion vector thus modified in 
the circuit 11b to produce a predictive high frequency 
component. 

The motion vector thus modified on the high fre- 25 
quency component is expressed by 



= (MV SX x n x , MV SY x n y ) 

where, MV L is the motion vector thus modified and 
M V s is the motion vector of the low frequency compo- 
nent given by MV S = <MV SX , MV SY ) and the sampling 35 
ratio of the incoming moving picture signal and the low 
frequency component is given by 1:n x and 1:ny in hori- 
zontal and vertical directions, respectively. 

The predictive high frequency component is sub- 
tracted from the high frequency component sent from 40 
the subtracter 10a by a subtracter 10b to produce an 
predictive error. The predictive error is divided into a 
plurality of blocks in an orthogonal transformer 13 
which produces transform coefficients. The transform 
coefficients are quantized by a quantizer 14 and are 45 
subjected to a variable length coding circuit 15 which 
effectively codes the high frequency component by 
reducing the amount of data by variable length coding 
such as the Huffman coding. 

The transform coefficients thus quantized from so 
the quantizer 14 is de-quantized by a de-quantizer 16 
and is subjected to an inverse orthogonal transformer 
17 which produces a decoded predictive error by 
inverse orthogonal transform such as IDCT (Inverse 
Discrete Cosine Transform). The decoded predictive 55 
error is added by an adder 17a to the predictive high 
frequency component sent from the second motion 
compensation circuit 11b to produce the decoded 



high frequency component which is then stored in the 
frame memory 12. 

When decoding, a moving picture of low resol- 
ution can be reproduced by decoding the low fre- 
quency component thus coded. The moving picture of 
low resolution and that of a high resolution can be 
reproduced by decoding both the low and high fre- 
quency components thus coded. Further, the original 
moving picture can be reproduced by adding the over- 
sampled decoded low frequency component and the 
decoded high frequency component to each other. A 
decoding system has local decoding sections re- 
spectively with respect to the moving pictures of low 
and high resolutions and which description is omitted. 

According to the coding described above, the 
same motion vector is used for both the low and high 
frequency components, so that the predictive low and 
high frequency components have a correlation there- 
between. This results in the amount of data to be 
coded for the high frequency component being dec- 
reased and the resolution of the moving picture being 
improved. 

A quantization error produced when the low fre- 
quency component is coded is motion-compensated 
by means of the predictive high frequency component 
including components which compensate the quanti- 
zation error, so that resolution of a reproduced picture 
is improved. 

The embodiment described above is an example 
of recursive-type interframe coding as shown in FIG. 
4A, while the following is an example of adaptive pre- 
vious and subsequent predictive interframe coding as 
shown in FIG, 4B, low and high frequency compo- 
nents being periodically coded by intra frame coding. 

In FIG. 2 which shows another preferred embodi- 
ment according to the present invention, the sub sam- 
pling circuit 1, orthogonal transformers 5 and 13, 
quantizers 6 and 14, variable length coding circuits 7 
and 15, de-quantizer 8, inverse orthogonal transfor- 
mer 9 and over sampling circuit 10 respectively func- 
tion the same as those in FIG. 1. 

Stored in frame memories 3 and 12 respectively 
are low and high frequency components to be intraf- 
rame-coded in a previous frame and a subsequent 
frame to a present frame, while stored in frame 
memories 18 and 19 respectively are low and high fre- 
quency components to be interframe-coded in a 
plurality of frames. The block diagram shown in FIG. 
2 is a non-recursive-type so that either decoded fre- 
quency components or un coded frequency compo- 
nents can be stored in those frame memories. 

In this embodiment, the uncoded low and high fre- 
quency components are used. 

On the low frequency component, a motion vector 
detection circuit 20 detects motion vectors respect- 
ively between the present frame and the previous 
intraframe and between the present frame and the 
subsequent intraframe being stored in the frame 
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memories 3 and 18, respectively. 

In a first motion compensation circuit 40, first and 
second pre-predictive low frequency components X, 
and X b are produced on the basis of the previous and 
subsequent intraframes respectively using the motion 
vectors detected by the detection circuit 20. 

As shown in FIG. 5, the first and second compo- 
nents Xf and X b are weighted according to time inter- 
vals between the present frame and the previous and 
subsequent intraframes respectively. The first and 
second components X, and Xt, thus weighted are 
added to each other to produce a third pre-predictive 
low frequency component X*,. One of the three com- 
ponents Xf, Xt> and X* is selected which has the least 
predictive error, as a predictive low frequency compo- 
nent to be supplied to an adder 1 a for the coding. The 
first motion compensation circuit 40 also produces a 
selection signal indicating which components among 
the three components X f , Xt, and X*, is selected. 

The motion vectors on the low frequency compo- 
nent are modified by a motion quantity modification 
circuit 110a according to a sampling ratio of the 
incoming moving picture signal and the low frequency 
component 

In a second motion compensation circuit 1 10b, a 
predictive high frequency component is produced on 
the basis of the motion vectors thus modified and high 
frequency components of the previous or the subse- 
quent intra frame or the both stored in the frame mem- 
ory 19. Prom which intra frame the predictive high 
frequency component is produced is the same as the 
predictive low frequency component, that is, it 
depends on the selection signal produced by the first 
motion compensation circuit. 

As mentioned above, the un coded high frequency 
components are used for the motion compensation, 
so that a de-quantizer and an inverse orthogonal 
transformer are not required for coding the high fre- 
quency component. 

This results in the amount of data to be coded for 
the high frequency component being decreased and 
the resolution of the moving picture being improved. 

Furthermore, owing to the low and high frequency 
components coded by intraframe coding, bckward 
reproduction can be done even if the low and high fre- 
quency components are stored in such as magnetic 
tapes and optical discs. 

In communication networks, conventionally it 
sometimes happens that data for a low frequency 
component only transmitted due to a transmission 
capacity, however in this embodiment, a high fre- 
quency component is correctly decoded in a moving 
picture signal following to an intraframe coded moving 
picture signal. 

Prediction is made by means of moving picture 
signals in previous and subsequent frames in this 
embodiment so that prediction efficiency is improved 
and the coding system in the embodiment functions 



well even in the case of scene change. 

FIG. 3 shows a further preferred embodiment of 
the coding system according to the present invention. 
In this embodiment, a motion vector of an incoming 
5 original moving picture signal stored in a frame mem- 
ory 20b is detected by a motion vector detection cir- 
cuit 20a. 

The motion vector is modified according to a sam- 
pling ratio of the incoming moving picture signal and 
10 a low frequency component by a motion quantity 
modification circuit 20c. The motion vector thus mod- 
ified is supplied to first and second motion compens- 
ation circuits 4 and 11b respectively for 
motion-compensated coding of low and high fre- 
ts quency components. The motion -compensated cod- 
ing is conducted in the same manner as explained 
referring to FIG. 1. 

The progressive coding systems described 
above through the three embodiments extract one low 
20 frequency component from an original moving picture 
signal per frame. However, not limited to the embodi- 
ments, any number of low frequency components of 
different levels of luminance variation may be extrac- 
ted per frame. 

25 The invention may be embodied in other specific 

forms without departing from the spirit or essential 
characteristics thereof. The present embodiments are 
therefore to be considered in all respects as illustra- 
tive and not restrictive, the scope of the invention 

30 being indicated by the appended claims rather than by < 
the foregoing description and all changes which come 
within the meaning and range of equivalency of the 
claims are therefore intended to be embraced therein. 



35 



Claims 



1 . A progressive coding system wherein a moving 
picture signal is separated into a low frequency 

40 component of a little luminance variation and a 

high frequency component of much luminance 
variation, and the components are respectively 
coded by motion compensated predictive coding, 
the system characterized by comprising: 

45 motion quantity modification means (11a) 

for modifying a motion quantity of the low -fre- 
quency component according to a sampling ratio 
of the moving picture signal and low frequency 
component; and 

so motion compensation means (11b) for mo- 

tion-compensating the high frequency compo- 
nent according to the motion quantity thus 
modified. 

55 2. A progressive coding system wherein a moving 
picture signal in a present frame is separated into 
a low frequency component or a little luminance 
variation in the present frame and a high fre- 
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quency component of much luminance variation 
in the present frame, and the components are re- 
spectively coded by motion compensated predic- 
tive coding, the system characterized by 
comprising: 5 

motion detection means (20) for respect- 
ively detecting motion quantities on the low fre- 
quency component in the present frame and low 
frequency components in previous and subse- 
quent intraframes to the present frame; 10 

first motion compensation means (40) for 
respectively motion-compensating the low fre- 
quency components in the previous and subse- 
quent intraframes according to the respective 
motion quantities to produce first and second pre- 15 
predictive low frequency components, weighting 
the pre- predictive low frequency components 
according to time intervals between the frames 
thereof to add the pre-predictive low frequency 
components thus weighted to each other, thus 20 
producing a third pre-predictive low frequency 
component, selecting one of the first, second and 
third pre-predictive low frequency components, of 
the least predictive error, as a predictive low fre- 
quency component for the motion compensated 25 
predictive coding and outputting a selection sig- 
nal indicating which is selected among the first, 
second and third pre-predictive low frequency 
components; 

motion quantity modification means (11 Oa) 30 
for respectively modifying the motion quantities 
according to a sampling ratio of the moving pic- 
ture signal and low frequency component; and 

second motion compensation means 
(1 10b) responsive to the selection signal for pro- 35 
ducing a predictive high frequency component on 
the basis of the modified motion quantities and 
the high frequency component of either the pre- 
vious or subsequent intraframe or both the intraf- 
rames in a manner identical to that in which the 40 
selected one of the first, second and third pre- 
predictive low frequency components is pro- 
duced. 




A2 10 

nent according to the motion quantity thus mod- 
ified; and 

second motion compensation means 
(11b) for motion-compensating the high fre- 
quency component according to the motion quan- 
tity thus modified. 



3. A progressive coding system wherein a moving 45 
picture signal is divided into a low frequency com- 
ponent of a little luminance variation and a high 
frequency component of much luminance vari- 
ation, and the components are respectively 
coded by motion compensated predictive coding, so 
the system characterized by comprising: 

motion quantity modification means (20c) 
for modifying a motion quantity of the moving pic- 
ture signal according to a sampling ratio of the 
moving picture signal and low frequency compo- 55 
nent; 

first motion compensation means (4) for 
motion-compensating the low frequency compo- 
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FIG. 4A 




PREVIOUS INTRAFRAME SUBSEQUENT INTRAFRAME 



FIG. 4B 
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@ Moving picture signal progressive coding system. 

(£7) A progressive coding system wherein a mov- 
ing picture signal is separated into a low fre- 
quency component of a little luminance 
variation and a high frequency component of 
much luminance variation, and the components 
are respectively coded by motion compensated 
predictive coding. The high frequency compo- 
nent is motion-compensated according to a 
motion quantity of the low frequency compo- 
nent The motion quantity is modified by a 
sampling ratio of the moving picture signal and 
low frequency component The motion quantity 
can be detected based on the low frequency 
component in a present frame and those sub- 
jected to intraframe coding in previous and 
subsequent i n lr a fr am es to the present frame. A 
predictive low frequency component is then 
obtained by motion compensation using the 
motion quantity according to time intervals of 
the low frequency components between the 
frames. A predictive high frequency component 
is also obtained like the predictive low fre- 
quency component referring to the time inter- 
val. A motion quantity of the moving picture 
signal is obtained for motion-compensating the 
low and high frequency components. 
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